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Start 



Capturing a Plurality of Real-Time Video Streams of a 
Local Participant From a Plurality of Camera 
Viewpoints 
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310 



Generating Real-Time Renderings of the Local 
Participant Based on the Plurality of Real-Time Video 
Streams by Applying a New View Synthesis 
Technique, Wherein the Real Time Renderings are 
Taken From a Perspective of a Remote Participant 
Located Remotely in the Gaming Environment 
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Sending the Real-Time Renderings to the Remote 
Participant for Viewing Within the Gaming 
Environment 
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End 



Fig. 3A 
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Generating the Real-Time Renderings from a 
Perspective Taken From a Second Location of the 
Remote Participant with Respect to a First Location of 
the Local Participant Within a Coordinate Space of 
the Virtual Gaming Environment 



Enabling a Change in at Least One of the First and 
Second Locations by Allowing the Local Participant 
and the Remote Participant to Navigate Through the 
Coordinate Space of the Virtual Gaming Environment 



Modifying the Real-Time Renderings to Reflect the 
Change in at Least One of the First and Second 

Locations 
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End 
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Fig. 3B 
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Blending the Real-Time Rendering Within a Synthetic 
Rendering of the Virtual Gaming Environment 
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Displaying the Real-Time Renderings Within the 
Virtual Gaming Environment at a Display Viewable by 
the Second Participant to Enable Real-Time Video 
Communication Between the Local Participant and 
the Remote Participant Within the Gaming 
Environment 
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End 



Fig. 3C 
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Start 



Capturing a Plurality of Real-Time Video Streams of a 
Local Participant From a Plurality of Camera 
Viewpoints 
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Generating a Video Image Stream in Real-Time of the 
Local Participant Based on the Plurality of Real-Time 
Video Streams by Applying a New View Synthesis 
Technique, Wherein the Video Image Stream is 
Rendered from a Persective of a Remote Participant 
Located Remotelly in the Gaming Environment 
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Incorporating the Video Image Stream Comprising 
Real-Time Photorealistic Features of the Local 
Participant Into a Graphically Generated Avatar, 

Wherein the Graphically Generated Avatar 
Represents the Local Participant in the Gaming 
Environment from a Perspective Associated with the 

Remote Participant 
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End 



Fig. 4 
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